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ABSTRACT 

This paper proposes a reduced-rank scheme for adaptive beamform- 
ing based on the constrained joint iterative optimization of filters. 
We employ this scheme to devise two novel reduced-rank adaptive 
algorithms according to the constant modulus (CM) criterion with 
different constraints. The first devised algorithm is formulated as 
a constrained joint iterative optimization of a projection matrix and 
a reduced-rank filter with respect to the CM criterion subject to a 
constraint on the array response. The constrained constant modulus 
(CCM) expressions for the projection matrix and the reduced-rank 
weight vector are derived, and a low-complexity adaptive algorithm 
is presented to jointly estimate them for implementation. The second 
proposed algorithm is extended from the first one and implemented 
according to the CM criterion subject to a constraint on the array re- 
sponse and an orthogonal constraint on the projection matrix. The 
Gram-Schmidt (OS) technique is employed to achieve this orthogo- 
nal constraint and improve the performance. Simulation results are 
given to show superior performance of the proposed algorithms in 
comparison with existing methods. 

Index rermi-Beamforming techniques, antenna array, con- 
strained constant modulus, reduced-rank methods. 

1. INTRODUCTION 

Adaptive beamforming technology is of paramount importance in 
numerous signal processing applications such as radar, wireless 
communications, and sonar (T|, (2). Among various beamforming 
techniques, the beamformers based on the constrained minimum 
variance (CMV) criterion ||3] are prevalent and minimize the con- 
tribution of the total output power while maintaining the gain along 
the direction of the signal of interest (SOI). Another alternative 
beamfoiTner design is performed according to the constrained con- 
stant modulus (CCM) |3| criterion, which is a positive measure 
of the beamformer output deviating from a constant modulus con- 
dition. Compared with the CMV, the CCM beamformers exhibit 
superior performance in many severe scenarios (e.g., steering vector 
mismatch). 

Many adaptive algorithms (3) have been developed according to 
the CMV and CCM criteria for implementation. A simple and popu- 
lar one is the stochastic gradient (SO) method |4|, |6|. However, the 
performance of the SG-based algorithms is sensitive to the step size, 
the number of interferers and sensor elements, and the eigenvalue 
spread (6|. For improving the performance, reduced-rank filtering 
has been introduced into beamforming in order to project the re- 
ceived signal onto a lower dimension subspace and perform the filter 
optimization within this subspace. This technique shows a fast con- 
vergence rate and improves tracking ability in situations where the 



number of sensor elements is large fT]. The Multi-stage Wiener fil- 
ter (MSWF) |8| and the auxiliary- vector filtering (AVF) |9| are two 
excellent approaches in this area. Employing these reduced-rank 
schemes, the CMV beamformers reach improved performance but 
suffer from the heavy computational cost and instability. A joint iter- 
ative optimization scheme 1 10| was presented recently with a simple 
adaptive implementation for reducing the complexity and improving 
the tracking ability. 

Considering the fact that the CCM-based beamformers outper- 
form the CMV ones for constant modulus constellations, we propose 
two adaptive reduced-rank algorithms according to the CCM crite- 
rion by employing a proposed reduced-rank scheme, which is based 
on the constrained joint iterative optimization filters. The proposed 
algorithms are implemented according to the constant modulus (CM) 
criterion with different constraints. The first one is formulated as a 
constrained joint iterative optimization of a projection matrix and 
a reduced-rank filter with respect to the CM criterion subject to a 
constraint on the aiTay response. The projection matrix projects the 
received signal onto a lower dimension, which is then processed by 
the reduced-rank filter for the array output. The CCM expressions 
for the projection matrix and the reduced-rank filter are derived, and 
a simple efficient algorithm is presented to jointly estimate them for 
implementation. The second proposed algorithm is extended from 
the first one and implemented according to the CM criterion subject 
to a constraint on the array response and an orthogonal constraint 
on the projection matrix. We employ the Gram Schmidt (GS) tech- 
nique II II to achieve this orthogonal constraint for the projection 
matrix reformulation. The performance of the second algorithm out- 
performs the first one. Simulation results are given to demonstrate 
the superior performance and stability achieved by the proposed al- 
gorithms versus the existing algorithms in typical scenarios. 

The remainder of this paper is organized as follows: we out- 
line a system model for beamforming in Section 2. Based on this 
model, the problem statement is presented. The proposed scheme, 
optimization and filter expressions are considered in Section 3. Sec- 
tion 4 derives the proposed adaptive reduced-rank algorithms. The 
GS technique is briefly introduced in this part. Simulation results are 
provided and discussed in Section 5, and conclusions are drawn in 
Section 6. 

2. SYSTEM MODEL AND PROBLEM STATEMENT 
2.1. System Model 

Let us suppose that q narrowband signals impinge on an uniform 
linear array (ULA) of m (m > q) sensor elements. The sources 
are assumed to be in the far field with directions of arrival (DOAs) 
00,. . . ,9q-i. The ith snapshot's vector of sensor array outputs 



x{i) g C™^^ can be modeled as 

x{i) ^ A{e)s{i) + n{i), i = l,...,N (1) 

where = [6*0, . . . , Oq-if G C""^ is the signal DOAs, A{0) = 
[a(8o), . . . , a{6q-i)] G C™^'' comprises the signal direction vec- 

tors a{9k) = [1, e-2"^"^^°^''^ . . ., 

^-2.i(™-i)£ccse,jT g = 0,...,g - 1), where Ac 

is the wavelength and d is the inter-element distance of the ULA 
(d — Ac/2 in general), and to avoid mathematical ambiguities, the 
direction vectors a{6k) are considered to be linearly independents. 
s{i) G is the source data, n{i) G C'"'^^ is temporarily white 
sensor noise, which is assumed to be a zero-mean spatially and Gaus- 
sian process, A'^ is the observation size of snapshots, and (•)"^ stands 
for transpose. The output of a narrowband beamformer is given by 



y{i) = w"{i)x{i) 



(2) 



where iy(i) — [wi (i), . . . , it)m(i)]^ G C™^^ is the complex weight 
vector, and (•)^ stands for Hermitian transpose. 

2.2. Problem Statement 

Let us consider the full-rank CCM optimization filter for beamform- 
ing, which can be computed by solving the following optimization 
problem 



Wont = argmin£;| \\yii)\'' - Rp]^}, i = 1, . . . , N 
subject to {i)a{Oo) = 1. 



(3) 



where the constant Rp is suitably chosen to guarantee that the weight 
solution is close to the global minimum and the constraint is set to 
ensure a closed-form solution. The quantity 9o is the direction of 
the SOI, a{9o) denotes the normalized steering vector of the desired 
signal, and in general, p = 2 is selected to consider the optimiza- 
tion as the expected deviation of the squared modulus of the array 
output to a constant, say Rp — 1. The CCM beamformer mini- 
mizes the contribution of undesired interference while maintaining 
the gain along the look direction to be constant. Using the method 
of Lagrange multipliers to solve the optimization problem in (jSjl, the 
weight expression is 



(4) 



where R = E[2{\y{i)f - l)x{i)x"{t)] G C'"""™ is the expected 
cross correlation matrix between x{i) and y{i). The complexity can 
be high due to the existence of the covariance matrix inverse. In 
practice, R is not available but has to be estimated, which may result 
in the poor convergence and tracking ability when m is large. Note 
that R depends on y{i), which is a function of current w{i). By 
initializing w{i) and estimating a prior y{i), we can estimate R and 
get the weight solution for each snapshot. 

3. PROPOSED REDUCED-RANK SCHEME AND CCM 
FILTERS DESIGN 

In this section, we employ a reduced-rank scheme to introduce two 
optimization problems according to the CM criteria subject to differ- 
ent constraints. The reduced-rank scheme is based on a constrained 
joint iterative optimization of a projection matrix and a reduced- 
rank filter. The CCM expressions of the projection matrix and the 
reduced-rank weight vector are derived. 
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Fig. 1. Proposed reduced-rank beamforming scheme. 



3.1. Proposed Reduced-Rank Scheme and Optimization Prob- 
lems 

Consider a projection matrix Tr(i) — [ti{i),t2{i), ■ ■ ■ , tr{i)] G 
Qmxr ^ which is responsible for the dimensionality reduction, to 
project the m x 1 input vector x{i) onto a lower dimension, yield- 
ing 

x{t) ^Tr{i)"x{{} (5) 

where = [tij{i),.. . ,tm.iii)f G C^^'S 1 = 1,.. ., r, makes 
up the projection matrix Tr{i), x{i) G C^^^ is the projected input 
vector, and in what follows, all r-dimensional quantities are denoted 
by an over bar. Here, r < m is the rank and, as we will see, impacts 
the output performance. An adaptive reduced-rank filter represented 
by w{i) = . . . ,-Wr{i)]^ G C^Ms followed to process the 

projected data for estimating the output 



y{i) = w" {i)T" {i)x(i) 



(6) 



From (|6}, the array output yii) depends on the projection matrix 
Tr{i) and the reduced-rank weight vector 10(1), as shown in Fig. [T] 
It is necessary to jointly optimize Trii) and ■ly(i) to estimate y{i). 
We consider two optimization problems, which are problem i) 



[T.,op„iyop,] = argmin£;{[|y(i)|'-l]'}, i = l,...,iV 
subject to {i)Tr{i)a{6o) = 1. 



(7) 



and problem ii) 



WoM = are mm 



aE{[\y{i)f -1]^}, i = l,...,N 



subject to w"{i)Tr{i)a(9o) = 1 and Tr(i)"Tr{i) = I. 



(8) 



Compared with problem i), problem ii) includes one orthogonal 
constraint on the projection matrix, which is to reformulate Trii) 
for improving the performance. In the following part, we will derive 
the CCM expressions of Tr{i) and ■u;(j) with respect to problem i). 
The proposed adaptive algorithm for the implementation of (|7]( and 
the extended algorithm for problem ii) will represent in Section 4. 

3.2. Design of CCM Filters 

The constraint in can be incorporated by the method of Lagrange 
multipliers |6| in the form 

J = E{[\y{i)\^ - 1]'} + \[w" {i)T? {i)a{eo) - l] (9) 

where A is a scalar Lagrange multiplier. Substituting (|6) into (|9), 
fixing wii), taking the gradient of (|9} with respect to T,.(i), and 
setting it equals to a null matrix, yields 



vjt, = J^T,(i)i^„, + \Tra(eo)w"{i) 



(10) 



where e{i) = I, R = E[2e{i)x{i)x" (i)] is the ex- 

pected cross correlation matrix, and Rw — E[w{i)'w^ (i)] is the 
expected reduced-rank weight matrix. Both R and Ru, need to be 
estimated by sample-averaging in practice. Note that R depends on 
y{i), which is a function of Tr{i) and w{i). By initializing Tr{i) 
and w{i) and using a prior y{i), we can estimate R. 

ReaiTanging the second equation of l IlO) to represent Tr{i), 
which is then substituted into the constraint in (|7} for solving the 
Lagrange multiplier At^, we get the result for the projection matrix 

r _ R-'a{eo)w''{t)R-' ^^j^ 

^y«(i)J^;:,'^u(i)a^^(eo)i^"'a(6»o) 

On the other hand, fixing Tr{i), taking the gradient of (|9) with 
respect to w{i), and setting it equal to a null vector, we have 

VJ^ = Rw{i) + A^Tf (j)a(eo) (12) 

where .R = E[2e{i)x{i)x^ (i)] G (^''X'' the expected reduced- 
rank cross correlation matrix, which is estimated by sample- 
averaging. Following the same procedures for Tr{i), the result 
for the reduced-rank weight solution can be expressed as 

w{i)= [a"{eo)R''a{eo)]''^R~^a{eo) (13) 

where a(6io) = Tf (j)a(6'o ) G ^ is the projected steering vector 
of the SOI. 

The update equations i ll It for the projection matrix and (113) for 
the reduced-rank weight vector depend on each other and so are not 
closed-form solutions. It is necessary to iterate Tr and w with ini- 
tial values for implementation. Therefore, the initialization is not 
only for obtaining a prior y but starting the iteration of the proposed 
scheme. The projection matrix creates a connection between the full- 
rank input vectors and the reduced-rank ones, whereas the reduced- 
rank filter recovers the transmitted signal. They are jointly updated 
to solve the CCM optimization problem i), i.e., the so-called '^joint 
iterative optimization" (JIO). 

4. DEVELOPMENT OF ADAPTIVE ALGORITHMS 

4.1. Proposed Adaptive SG Algorithm for Problem i) 

We describe a simple adaptive algorithm for implementation of the 
proposed reduced-rank scheme based on the optimization problem 
i). Fixing ■ly(i) and Tr{i), respectively, taking the instantaneous 
gradient of Q with respect to Tr(i) and ■w{i), and setting them 
equal to null, we obtain 

VJp,T, = 2e{i)y* {i)x{i)w" {i) ^ Xp,tMSo)w" (i) (14) 

VJp,^ = 2e{i)y*{i)T^{i)x{i) + Ap,»Tf (i)a(6»o) (15) 

where the subscript "p" means the proposed and (■)* denotes com- 
plex conjugate. 

Following the gradient rules Tr{i + 1) = Tr{i) — fJ-T^^ Jp,T,. 
and w{i -f 1) = w{i) — /i^ VjTp,™, substituting l ll4t and il5\ into 
them, respectively, and solving the Lagrange multipliers Xp,Tr and 
Xp.w by employing the constraint in Q, we obtain the iterative so- 
lutions in the form 

Tr{i + 1) = T,(i)-MT.e(i)y*(i) [xii)w" {£) ^^^^ 
— a{9o)w'^ {i)a^ {i)x{i)] 

^,(, + 1) = ^(,) _ ^^eii)y'{^) [l - ''J!!f,'',lf'\ ] Hi) (17) 



Table 1. Computational complexity 
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where /it,, and /i^, are the corresponding step sizes, which are small 
positive values. The projection matrix T,.(i) and the reduced-rank 
weight vector ■w{i) are jointly updated. The output y{i) at time in- 
stant i can be estimated after each joint optimization procedure with 
respect to the CCM criterion. We denominate this proposed algo- 
rithm ((Tell and O?}) as JIO-CCM. 

4.2. Extended Algorithm for Problem ii) 

Now, we consider the optimization problem ii). As explained before, 
the constraint is added to orthogonalize a set of vectors ti{i) for 
the performance improvement. We employ the Gram-Schmidt (GS) 
technique 1 1 1 1 to realize this constraint. Specifically, the adaptive 
SG algorithm in ( I16t is implemented to obtain T,.(i + 1). Then, the 
GS process is performed to reformulate the projection matrix, which 
is (II] 

i-i 

3 = 1 

where ti_a„{i) is the normalized orthogonal vector after the GS pro- 
cess and projj^ = tjfort(»)ti(») ^gj^-^t^^^.) is a projection 
operator. 

The reformulated projection matrix T,.,ort(i) is constructed 
when we obtain a set of orthogonal t;,ort(i), I ~ 1, . . . , r. By em- 
ploying Tr,ort(i) to get x(i), d{9o), andjointly update with 1) 
in l |17t , the performance can be further improved. Simulation results 
will be given for showing this result. We denominate this GS version 
algorithm as JIO-CCM-GS, which is performed by computing ( I16t . 
iQlll, and (nil. 

4.3. Computational Complexity 

The computational complexity with respect to the existing and pro- 
posed algorithms is evaluated according to additions and multipli- 
cations. The complexity comparison is listed in Tabled) The com- 
plexity of the proposed JIO-CCM and JIO-CCM-GS algorithms in- 
creases with the multiplication of rm, specifically m since the rank 
r is selected around a small range that is much less than m in large 
arrays' conditions without performance degradation. This fact will 
be shown in the simulation. This complexity is about r times higher 
than the full-rank algorithms |4|, |6|, slightly higher than the recent 
JIO-CMV based algorithm 1 10|, but much lower than the MSWF- 
based L8J, [13], and AVF |9 | methods. 



5. SIMULATIONS 

Simulations are perfoimed by an ULA containing m = 32 sensor 
elements with half-wavelength interelement spacing. We compare 
the proposed JIO-CCM and JIO-CCM-GS algorithms with the full- 
rank 1 6 1 , MS WF 1 8 1 , 1 1 3 1 , and AVF 1 9 1 methods and in each method, 
the CMV and CCM criterions are considered with SG algorithms 
for implementation. A total of K = 1000 runs are used to get the 
curves. In all experiments, the BPSK source power (including the 
desired user and interferers) is — — 1 and the input SNR 
= 10 dB with spatially and temporally white Gaussian noise. 

In Fig. (2] we consider the presence of g = 7 users (one desired) 
in the system. The projection matrix and the reduced-rank weight 
vector are initialized with Tr{0) = [Ir O'^x(m-r)] ™d w{0) — 
(Tf (0)a(6lo))/(||Tf (0)a(6»o)f ) to ensure the constraint in Q. 
The rank is r — Vgs —5 for the proposed JIO-CCM and JIO- 
CCM-GS algorithms. The expected matrix R used in the MSWF 
and AVF is estimated by sample-averaging. Fig. |2] shows that all 
output SINR curves increase to steady-state as increase of the snap- 
shots. The joint optimization based algorithms have superior perfor- 
mance as compared with the full-rank, MSWF, and AVF methods. 
Their GS version algorithms enjoy further developed performance 
comparing with corresponding JIO-CMV and JIO-CCM methods. 
The proposed JIO-CCM and JIO-CCM-GS algorithms outperforms 
the existing methods in the output performance. Checking the con- 
vergence, the proposed algorithms are slightly slower than the AVF, 
which is least squares (LS)-based, and much faster than the other 
methods. 
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Fig. 2. Output SINR versus the number of snapshots with m = 32, 
g = 7, SNR= 10 dB, pr, = 0.002, /Xio = 0.001, /ir^.gs = 0.003, 
liw,g. = 0.0007. 



In Fig. [3] we keep the same scenario as that in Fig. |2]and check 
the rank selection for the existing and proposed algorithms. The 
number of snapshots is fixed to A*' = 500. The optimum choices for 
the proposed algorithms are r — rgs = 5, which are comparatively 
lower than most existing algorithms, but reach superior performance. 
We also checked the change of these values for different array sizes 
and data records, and verified that they are nearly invariant, which 
saves computation cost. 

Finally, the mismatch (steering vector error) condition is ana- 
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Fig. 3. Output SINR versus rank (r) with m = 32, q = 7, SNR= 10 
dB, N = 500, fiTr. = 0.002, = 0.001, /.tT^gs = 0.003, At»,gs = 
0.0007. 



lyzed in Fig. |4] Here, the number of users is q = 10, including one 
desired user. In Fig. |4ja), the exact DOA of the SOI is used in the 
algorithms. The output performance of the proposed algorithms is 
better than those of the existing algorithms, and the convergence is 
a little slower than that of the AVF algorithm, but higher than the 
others. In Fig. |4jb), we set the DOA of the SOI estimated by the re- 
ceiver to be 2° away from the actual direction. This indicates that the 
mismatch problem induces performance degradation to all the ana- 
lyzed algorithms. The CCM-based methods are more robust to this 
scenario than the CMV-based ones. The proposed algorithms still 
retain outstanding performance compared with other techniques. 
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Fig. 4. Output SINR versus the number of snapshots with m — 32, 
q = 10, SNR= 10 dB, ^t, = 0.002, fi^ = 0.001, ^r^.gs = 0.003, 
Mui.gs = 0.0007 for (a) ideal steering vector condition; (b) steering 
vector mismatch 2°. 



6. CONCLUDING REMARKS 

We proposed a reduced-rank scheme based on the joint iterative 
optimization filters for beamforming and devised two adaptive 
reduced-rank algorithms according to the CCM criteria, namely, 
JIO-CCM and JIO-CCM-GS. They are implemented by employing 
a low-complexity adaptive algorithm to jointly update the projection 
matrices and reduced-rank filters. The JIO-CCM-GS algorithm, by 
reformulating the projection matrix, achieves faster convergence 
and better performance than the JIO-CCM. The GS technique is 
employed to realize the reformulation. The devised algorithms, 
compared with the existing methods, show preferable performance 
and fast convergence in the studied scenarios. 
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